deep neural network

A deep neural network is a neural network with lots of layers.. Tyoically the layers are also large, in the sense of lots of nodes. Each layer can also have a differnt size and use different types of learning. For example, it is common for the first layer to be a restricted Boltzmann machine in order to perform dimensional reduction. Typically the inner laters are underdetermined (many equally good arrangements of weightings); this and theor disrance from the output layer means that backpropagation or similar learning rules need to have very slow learning rates to avoid instabilities. In addition, more layers and laregr layers usually requires more training data. Together these mean that deep learning (training of deep neural networks) requires. a lot of training data. This combination of computational cost and data volume is one of the main reasons that the use deep neural networks were not widely adopted for many years.